Header replication in accelerated TCP (Transport Control Protocol) stack processing

ABSTRACT

In one embodiment, a method is provided. The method of this embodiment provides storing a packet header at a set of at least one page of memory allocated to storing packet headers, and storing the packet header and a packet payload at a location not in the set of at least one page of memory allocated to storing packet headers.

PRIORITY INFORMATION

This application is a continuation of U.S. patent application Ser. No.11/140,092, filed May 26, 2005, which is a continuation-in-part of U.S.patent application Ser. No. 11/027, 719, filed Dec. 30, 2004, now U.S.Pat. No. 8,121,125; which is a continuation-in-part of U.S. patentapplication Ser. No. 10/815,895 filed Mar. 31, 2004, now U.S. Pat. No.7,783,769, and claims the benefit of priority thereof.

RELATED APPLICATIONS

This application is related to U.S. patent application Ser. No.10/954,248 entitled “Storing Packet Headers”, filed Sep. 29, 2004.

FIELD

Embodiments of this invention relate to accelerated TCP (TransportControl Protocol) stack processing.

BACKGROUND

Networking has become an integral part of computer systems. Advances innetwork bandwidths, however, have not been fully utilized due tooverhead that may be associated with processing protocol stacks. Aprotocol stack refers to a set of procedures and programs that may beexecuted to handle packets sent over a network, where the packets mayconform to a specified protocol. For example, TCP/IP (Transport ControlProtocol/Internet Protocol) packets may be processed using a TCP/IPstack.

Overhead may result from bottlenecks in the computer system from usingthe core processing module of a host processor to perform slow memoryaccess functions such as data movement, as well as host processor stallsrelated to data accesses missing the host processor caches. Each memoryaccess that occurs during packet processing may represent a potentialdelay as the processor awaits completion of the memory operation.

One approach to reducing overhead is to offload protocol stackprocessing. For example, TCP/IP stack processing may be offloaded onto aTCP/IP offload engine (hereinafter “TOE”). In TOE, the entire TCP/IPstack may be offloaded onto a networking component, such as a MAC (mediaaccess control) component, of an I/O subsystem, such as a NIC (networkinterface controller). However, use of a TOE to process the entireTCP/IP stack may not scale well to support a large number of connectionsdue to the memory requirements associated with storing contextsassociated with these connections.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention are illustrated by way of example,and not by way of limitation, in the figures of the accompanyingdrawings and in which like reference numerals refer to similar elementsand in which:

FIG. 1 illustrates a network.

FIG. 2 illustrates a system according to one embodiment.

FIG. 3 is a flowchart illustrating a method according to one embodiment.

FIG. 4 is a flowchart illustrating a method according to anotherembodiment.

FIG. 5 is a flowchart illustrating a method according to anotherembodiment.

FIGS. 6A-6D illustrate storage of packet headers.

FIG. 7 is a flowchart illustrating a process to store packet headers.

FIG. 8 is a flowchart illustrating a process to prefetch packet headersinto a cache.

FIG. 9 illustrates a diagram of a computer system.

FIG. 10 illustrates a second embodiment to store packet headers.

FIG. 11 is a flowchart illustrating a second embodiment to store packetheaders.

FIG. 12 is a flowchart illustrating header replication.

DETAILED DESCRIPTION

Examples described below are for illustrative purposes only, and are inno way intended to limit embodiments of the invention. Thus, whereexamples may be described in detail, or where a list of examples may beprovided, it should be understood that the examples are not to beconstrued as exhaustive, and do not limit embodiments of the inventionto the examples described and/or illustrated.

FIG. 1 illustrates a network 100 in which embodiments of the inventionmay operate. Network 100 may comprise a plurality of nodes 102A, . . .102N, where each of nodes 102A, . . . 102N may be communicativelycoupled together via a communication medium 104. As used herein,components that are “communicatively coupled” means that the componentsmay be capable of communicating with each other via wirelined (e.g.,copper wires), or wireless (e.g., radio frequency) means. Nodes 102A . .. 102N may transmit and receive sets of one or more signals via medium104 that may encode one or more packets.

As used herein, a “packet” means a sequence of one or more symbolsand/or values that may be encoded by one or more signals transmittedfrom at least one sender to at least one receiver. As used herein, a“communication medium” means a physical entity through whichelectromagnetic radiation may be transmitted and/or received.Communication medium 104 may comprise, for example, one or more opticaland/or electrical cables, although many alternatives are possible. Forexample, communication medium 104 may comprise air and/or vacuum,through which nodes 102A . . . 102N may wirelessly transmit and/orreceive sets of one or more signals.

In network 100, one or more of the nodes 102A . . . 102N may compriseone or more intermediate stations, such as, for example, one or morehubs, switches, and/or routers; additionally or alternatively, one ormore of the nodes 102A . . . 102N may comprise one or more end stations.Also additionally or alternatively, network 100 may comprise one or morenot shown intermediate stations, and medium 104 may communicativelycouple together at least some of the nodes 102A . . . 102N and one ormore of these intermediate stations. Of course, many alternatives arepossible.

At least one of nodes 102A, . . . , 102N may comprise system 200, asillustrated in FIG. 2. System 200 may comprise host processor 202, hostmemory 204, bus 206, and chipset 208. (System 200 may comprise more thanone host processor 202, host memory 204, bus 206, and chipset 208, orother types of processors, memories, and busses; however, the former areillustrated for simplicity of discussion, and are not intended to limitembodiments of the invention.) Host processor 202, host memory 204, bus206, and chipset 208 may be comprised in a single circuit board, suchas, for example, a system motherboard 238.

Host processor 202 may comprise a core processing module and othersupport modules that interface with other system elements. For example,a support module may include a bus unit that communicates with a memorycontroller on system 200. Host processor 202 may comprise, for example,an Intel® Pentium® microprocessor that is commercially available fromthe Assignee of the subject application. Of course, alternatively, hostprocessor 202 may comprise another type of microprocessor, such as, forexample, a microprocessor that is manufactured and/or commerciallyavailable from a source other than the Assignee of the subjectapplication, without departing from embodiments of the invention.

Host processor 202 may be communicatively coupled to chipset 208.Chipset 208 may comprise a host bridge/hub system that may couple hostprocessor 202 and host memory 204 to each other and to bus 206. Chipset208 may also include an I/O bridge/hub system (not shown) that maycouple the host bridge/bus system to bus 206. Chipset 208 may compriseone or more integrated circuit chips, such as those selected fromintegrated circuit chipsets commercially available from the Assignee ofthe subject application (e.g., graphics memory and I/O controller hubchipsets), although other one or more integrated circuit chips may also,or alternatively, be used.

Bus 206 may comprise a bus that complies with the Peripheral ComponentInterconnect (PCI) Local Bus Specification, Revision 2.2, Dec. 18, 1998available from the PCI Special Interest Group, Portland, Oreg., U.S.A.(hereinafter referred to as a “PCI bus”). Alternatively, bus 106 insteadmay comprise a bus that complies with the PCI-X Specification Rev. 1.0a,Jul. 24, 2000, (hereinafter referred to as a “PCI-X bus”), or a bus thatcomplies with the PCI-E Specification Rev. PCI-E (hereinafter referredto as a “PCI-E bus”), as specified in “The PCI Express BaseSpecification of the PCI Special Interest Group”, Revision 1.0a, bothavailable from the aforesaid PCI Special Interest Group, Portland,Oreg., U.S.A. Also, alternatively, bus 106 may comprise other types andconfigurations of bus systems.

System 200 may additionally comprise circuitry 216. Circuitry 216 maycomprise one or more circuits to perform one or more operationsdescribed herein as being performed by, for example, a driver 222 and/ornetwork controller 212. In embodiments of the invention, driver 222 mayperform accelerated processing as described below, and may be referredto as a TCP-A (Transport Control Protocol-Accelerated) driver.

References to TCP-A driver herein may describe any driver that mayperform accelerated processing when called upon to perform acceleratedprocessing, and references to TCP driver herein may describe any driverthat may perform non-accelerated processing when called upon to performnon-accelerated processing. TCP-A driver need not be a distinct driverfrom TCP driver, but may instead comprise a driver that may performeither non-accelerated or accelerated processing. For example, driver222 may comprise a TCP driver that may also perform acceleratedprocessing.

Circuitry 216 may be hardwired to perform the one or more operations,and/or may execute machine-executable instructions to perform theseoperations. For example, circuitry 216 may comprise memory 236 that maystore machine-executable instructions 226 that may be executed bycircuitry 216 to perform these operations. Instead of being comprised inhost processor 202, or chipset 208, some or all of circuitry 216 may becomprised in a circuit card (not shown), and/or other structures,systems, and/or devices that may be, for example, comprised inmotherboard 238, and/or communicatively coupled to bus 206, and mayexchange data and/or commands with one or more other components insystem 200. Circuitry 216 may comprise, for example, one or more digitalcircuits, one or more analog circuits, one or more state machines,programmable circuitry, and/or one or more ASIC's (Application-SpecificIntegrated Circuits).

System 200 may additionally comprise one or more memories to storemachine-executable instructions 226 capable of being executed, and/ordata capable of being accessed, operated upon, and/or manipulated bycircuitry, such as circuitry 216. For example, these one or morememories may include host memory 204, or memory 236. One or morememories 204, 236 may, for example, comprise read only, mass storage,random access computer-readable memory, and/or one or more other typesof machine-readable memory. The execution of program instructions 226and/or the accessing, operation upon, and/or manipulation of data bycircuitry 216 may result in, for example, circuitry 216 carrying outsome or all of the operations described herein as being carried out byvarious hardware and/or software components in system 200.

For example, machine-executable instructions 226 may comprise a set ofinstructions for an application 218; a set of instructions for operatingsystem 220; a set of instructions for TCP-A driver 222; and/or a set ofinstructions for DMA driver 224. In one embodiment, circuitry 216 ofhost processor 202 may execute machine-executable instructions 226 forTCP-A driver 222, for DMA driver 224, and for operating system 220.Machine-executable instructions 226 may execute in memory by circuitry216, such as in host processor 202, and/or by circuitry 216 in general.

A method according to one embodiment is illustrated in the flowchart ofFIG. 3 with reference to system 200 of FIG. 2. The method begins atblock 300, and continues to block 302 where network controller 212 mayreceive an indication that one or more packets 228 (only one shown),each comprising a header 230 and a payload 232, have been received fromnetwork 100. In an embodiment, network controller 212 may performstateless assists. “Stateless assists” refer to operations that may beperformed independently of the connection context. As used herein,“connection context” refers to information about a connection. Forexample, the information may comprise the sequence number of the lastpacket sent/received, and amount of memory available. Performingstateless assists may reduce the burden on the network controller 212.Stateless assists may include, but are not limited to, splitting theheader and payload, header parsing, hashing, posting queues, large sendoffload, and checksum offload.

For example, for each packet 228, network controller 212 may splitheader 230 and payload 232 from packet 228, and post each 230, 232 toone or more buffers 214A, 214B. In one embodiment, header 230 may beposted to a first buffer such as header buffer 214A, and payload 232 maybe posted to a second buffer such as data buffer 214B. This feature inwhich a packet is split into a header portion and a payload portion isreferred to herein as a split header feature. With split header,circuitry may perform parsing to determine where the header ends and thepayload starts. The header and payload may be stored in separatelocations (e.g., first and second buffers).

In another embodiment, header 230 may additionally be stored in thesecond buffer. In an embodiment, this may result from using the splitheader feature, and placing the header in the same location in which thepayload is stored. In other embodiments, this may result from using aheader replication feature. In header replication, circuitry may storethe header and the payload (i.e., the packet) at a first location (e.g.,second buffer), and store a predetermined number of bytes of the packetin a second location (e.g., first buffer). The predetermined number maycorrelate to a number of bytes of the header in a packet, and may beconfigurable. With header replication, circuitry does not need toperform parsing to determine where the header ends and the payloadbegins.

The one or more packets 228 may be comprised in one or more groups, andeach group of packets 228 may be transmitted and/or received over aconnection. The one or more packets 228 may be received in response to aread data request from, for example, application 218.

“Application” refers to one or more programs that use the network. Anapplication 218 may comprise, for example, a web browser, an emailserving application, a file serving application, or a databaseapplication. In conjunction with a read data request, application 218may designate destination read buffer 214C where application 218 mayaccess the requested data. In conjunction with a transmit data request,application 218 may write data to be transmitted to source buffer 214D.

“Network controller” refers to any combination of hardware and/orsoftware that may process one or more packets sent and/or received overa network. In an embodiment, network controller may comprise, forexample, a MAC (media access control) layer of the Data Link Layer asdefined in the Open System Interconnection (OSI) model for networkingprotocols. The OSI model is defined by the International Organizationfor Standardization (ISO) located at 1 rue de Varembé, Case postale 56CH-1211 Geneva 20, Switzerland.

A “connection” as used herein refers to a logical pathway to facilitatecommunications between a first node on a network and a second node onthe network. A connection may facilitate communications for one or moretransactions between the first node and the second node. A “transaction”refers to a request to send or receive data, such as may be initiated byan application, such as application 218, on a system, such as system200. Each connection may be associated with a connection context.

In an embodiment, network controller 212 may determine if the connectionis an accelerated connection in which one or more packets 228 may beoffloaded to TCP-A driver 222 for accelerated processing prior tosplitting header 230 and payload 232 and continuing to block 304. Inother embodiments, network controller 212 may split one or more packets228 into header 230 and payload 232 without first determining ifconnection is an accelerated connection. One example of how to determineif a connection is an accelerated connection is described in U.S. patentapplication Ser. No. 11/018,448 filed on Dec. 20, 2004, entitled“Connection Context Prefetch”.

At block 304, if the connection is an accelerated connection, andtherefore one or more packets 228 may be candidates for acceleratedpacket processing (packets may be referred to as offload packets),network controller 212 may notify a driver that one or more packets 228have arrived, and may indicate header buffer 214A and data buffer 214Bto a driver (e.g., TCP-A driver) for accelerated processing, such asfrom blocks 306-318. Alternatively, if the connection is not anaccelerated connection, and therefore one or more packets 228 may not becandidates for accelerated processing (packets may be referred to asnon-offload packets), network controller 212 may indicate data buffer214B (which includes header portion and data portion of the packet) to adriver (e.g., TCP driver) to perform regular, non-acceleratedprocessing.

In one embodiment, network controller 212 may notify TCP-A driver 222 bynotifying operating system 220 in accordance with an interruptmoderation scheme. An interrupt moderation scheme refers to a conditionwhere an interrupt may be asserted for every n packets received bynetwork controller 212. Thus, if network controller 212 receives n ormore packets, network controller 212 may notify operating system 220that packets have arrived. Likewise, if network controller 212 receivesless than n packets, network controller 212 may instead wait until morepackets are received before notifying operating system 220. In oneembodiment, operating system 220 may then notify TCP-A driver 222 thatpackets are ready to be processed.

At block 306, TCP-A driver 222 may perform packet processing for atleast one of the one or more packets. Packet processing may be performedby the TCP-A driver 222 retrieving header 230 from post buffer 214A,parsing the header 230 to determine the connection context associatedwith the current connection (if this has not already been done), andperforming TCP protocol compliance. TCP protocol compliance maycomprise, for example, verifying the sequence number of a receivedpacket to ensure that the packet is within a range of numbers that wasagreed upon between the communicating nodes; verifying the payload sizeto ensure that the packet is within a range of sizes that was agreedupon between the communicating nodes; ensuring that the header structureconforms to the protocol; and ensuring that the timestamps are within anexpected time range.

TCP-A driver 222 may fetch a next header to process prior to completingthe processing of a current header. This may ensure that the next headeris available in the host processor's caches (not shown) before the TCP-Adriver 222 is ready to perform TCP processing on it, thereby reducinghost processor stalls. Prefetching the header is described in moredetail below. The method may continue to block 308.

In one embodiment, TCP-A driver 222 may additionally determine if aconnection associated with a packet is to be accelerated prior toperforming packet processing. This may be done, for example, if networkcontroller 212 has not already made this determination. TCP-A driver 222may accelerate select connections. Select connections may comprise, forexample, connections that are long-lived, or which comprise large data.If TCP-A driver 222 determines that network connection is to beaccelerated, TCP-A driver 222 may perform packet processing as describedat block 306. If TCP-A driver 222 determines that network connection isnot to be accelerated, the method may continue to block 318.

At block 308, TCP-A driver 222 may determine if one or more payloads 232placed in post buffer 214B are ready for placement. A payload 232 may beready for placement if, for example, the corresponding header has beensuccessfully processed, and a read buffer, such as read buffer 214C, hasbeen designated. If at block 308, payload 232 is not ready forplacement, the method may continue to block 310. In one embodiment,TCP-A driver 222 may determine if there are one or more payloads 232ready for placement at anytime. For example, if it is determined thatpayload 232 is not ready for placement, TCP-A driver 222 may wait forsome period of time before it makes this determination again. Wherepayload 232 cannot be placed because a read buffer 214C does not exist,for example, TCP-A driver 222 may alternatively or additionally atanytime indicate to operating system 220 the presence of payload 232ready to be placed. Operating system 220 may then designate a buffer, ormay ask application 218 to designate a buffer. If there are one or morepayloads ready for placement, the method may continue to block 312.

At block 310, TCP-A driver 222 may determine if there are more packets228 to process, for example in post buffer 214A, of the n packets forthe current interrupt. If there are more packets 228 to process, themethod reverts to block 306. If there are no more packets 228, and oneor more packets 228 have not been previously placed, and are ready forplacement, the method may continue to block 312. If there are no morepackets 228 to process, and there are no previous packets 228 to place,the method may continue to block 314.

At block 312, TCP-A driver 222 may perform one or more operations thatresult in a data movement module placing one or more correspondingpayloads 232 into a read buffer, such as read buffer 214C. As usedherein, a “data movement module” refers to a module for moving data froma source to a destination without using the core processing module of ahost processor, such as host processor 202. A data movement module maycomprise, for example, a DMA engine as described below.

In one embodiment, for example, TCP-A driver 222 may send a request toDMA driver 224, and DMA driver 224 may schedule a request with DMAengine 210 to write the one or more payloads 232 from post buffer 214Bto read buffer 214C. In another embodiment, TCP-A driver 222 maydirectly program DMA engine 210 to write the one or more payloads 232from post buffer 214B to read buffer 214C. DMA driver 224 may be astandalone driver, or part of some other driver, such as TCP-A driver222. Rather than being part of chipset 208, DMA engine 210 may be asupport module of host processor 202. By using the DMA engine forplacement of data, host processor 202 may be freed from the overhead ofperforming data movements, which may result in the host processor 202running at much slower memory speeds compared to the core processingmodule speeds. Following the DMA engine 210 scheduling, the method mayrevert to block 310 to determine if there are additional packets 228 toprocess.

At block 314, TCP-A driver 222 may determine if there are any pendingDMA completions for the current interrupt. Alternatively, TCP-A driver222 may look for DMA completions at anytime. A “pending completion” asused herein refers to the completion of a request. In one embodiment, apending completion refers to the completion of a request to DMA engine210 to write one or more payloads 232. If, at block 314, there are oneor more pending DMA completions for the current interrupt, the methodmay continue to block 316. If at block 314 there are no pending DMAcompletions for the current interrupt, the method may continue to block318.

At block 316, TCP-A driver 222 may perform other tasks. Other tasks mayinclude looking for more packets in a subsequent interrupt, setting upthe DMA engine 210 to issue an interrupt upon completion of a lastqueued task for the current interrupt, or other housekeeping, such astransmitting data, and performing TCP timer related tasks.

At block 318, TCP-A driver 222 may pass control back to operating system220. If all packets 228 have been processed, operating system 220 maywait for a next interrupt. If one or more packets 228 have still notbeen processed, operating system 220 may notify a TCP driver (not shown)rather than TCP-A driver 222, where the TCP driver may perform TCP stackprocessing by performing packet processing, and by using the coreprocessing module of host processor 202 to perform data transfers. TCPdriver may implement one or more host network protocols, also known ashost stacks, to process one or more packets 228.

The method may end at block 320.

A method according to another embodiment is illustrated in FIG. 4. Themethod begins at block 400 and continues to block 402 where operatingsystem 220 may receive a request from application 218 to transmit data234 placed in buffer 214D. Operating system 220 may perform preliminarychecks on data 234. Preliminary checks may include, for example,obtaining the associated connection context. In a TCP/IP connection, forexample, connection context may comprise packet sequence numbers toidentify the order of the packets, buffer addresses of buffers used tostore data, and timer/timestamp information for retransmissions.

At block 404, operating system 220 may notify TCP-A driver 222 thatthere is data 234 to be transmitted from buffer 214D.

At block 406, TCP-A driver 222 may perform one or more operations thatresult in data 234 being transmitted to network controller 212. Forexample, these one or more operations may include TCP-A driver 222programming DMA engine 210 to transmit data 234 from source buffer 214Dto network controller 212. Alternatively, TCP-A driver 222 may queue abuffer, such as queued buffer 214E, to network controller 212, wherenetwork controller 212 may instead read data 234 from queued buffer214E. Source buffer 214D may be designated by application 218, forexample, and queued buffer 214E may be designated by network controller212, for example.

In one embodiment, TCP-A driver 222 may program DMA engine 210 totransmit data if the data is small, and TCP-A driver 222 may queue abuffer, such as queued buffer 214E, if the data is large. As usedherein, “queuing a buffer” means to notify a controller that there is abuffer from which it can access data. For example, TCP acknowledgmentpackets to acknowledge receipt of packets may typically be relativelysmall-sized packets, and may be sent by TCP-A driver 222 to networkcontroller 212 by TCP-A driver 222 programming DMA engine 210 totransmit data 234. As another example, storage applications that sendlarge files over the network may be relatively large, and may thereforebe sent by TCP-A driver 222 to network controller 212 by queuing buffer214E.

At block 408, in response to receiving the data, network controller 212may create one or more packets for transmission by packetizing the data.In one embodiment, network controller 212 may packetize data byperforming segmentation on the data. “Segmentation” refers to breakingthe data into smaller pieces for transmission. In one embodiment,network controller 212 may include a MAC, and segmentation may bereferred to as a large send offload, wherein MAC frames may be createdfor transmission of data 234 over the network. Network controller 212may receive data directly from TCP-A driver 222, or by accessing queuedbuffer 214E.

The method may end at block 410. Thereafter, operating system 220 maysend a completion notification to application 218. Furthermore, sourcebuffer 214D may be returned to application 218, and application may usethe buffer for other purposes.

A method for accelerated processing in accordance with anotherembodiment is illustrated in FIG. 5. The method of FIG. 5 begins atblock 500 and continues to block 502 where packet processing may beperformed on one or more packets. Packet processing may be performed,for example, as described at block 306 of FIG. 3. This may be performedby, for example, a transport protocol driver, where the protocol mayinclude, for example, TCP/IP. The method may continue to block 504.

At block 504, substantially simultaneously with performing packetprocessing, a data movement module may be used to place one or morepayloads corresponding to the one or more packets into a read buffer.Use of a data movement module to place one or more payloadscorresponding to the one or more packets into a read buffer may beperformed, for example, as described at block 312 of FIG. 3. As usedherein, “substantially simultaneously” means at or around the same timeas another process so that there is some overlap between the twoprocesses, but does not necessarily mean that the two processes mustbegin and end execution at the same time. Thus, data movement may occurat some point during packet processing, including prior to packetprocessing, subsequent to packet processing, and/or during packetprocessing. The method may continue to block 506.

At block 506, the method of FIG. 5 may end.

As discussed above, each memory operation that occurs during packetprocessing may represent a potential delay. Given that reading a packetheader may occur for nearly every packet, storing the header in aprocessor's cache can greatly improve packet processing speed.Generally, however, a given packet's header will not be in cache whenthe stack first attempts to read the header. For example, in manysystems, a NIC receiving a packet writes the packet into memory andsignals an interrupt to a processor. In this scenario, the protocolsoftware's initial attempt to read the packet's header results in a“compulsory” cache miss and an ensuing delay as the packet header isretrieved from memory.

FIGS. 6A-6D illustrate techniques that may increase the likelihood thata given packet's header will be in a processor's cache when needed bycollecting packet headers into a relatively small set of memory pages.By splitting a packet apart and excluding packet payloads from thesepages, a larger number of headers can be concentrated together. Thisreduced set of pages can then be managed in a way to permit effectiveprefetching of packet headers into the processor cache before theprotocol stack processes the header.

In greater detail, FIG. 6A depicts a sample computer system thatfeatures a processor 604, memory 602, and a NIC 600. Memory 602 isorganized as a collection of physical pages of contiguous memoryaddresses. The size of a page may vary in different implementations.

In this sample system, the processor 604 includes a cache 606 and aTranslation Lookaside Buffer (TLB) 608. Briefly, many systems provide avirtual address space that greatly exceeds the available physicalmemory. The TLB 608 is a table that cross-references between virtualpage addresses and the currently mapped physical page addresses forrecently referenced pages of memory. When a request for a virtualaddress results in a cache miss, the TLB 608 is used to translate thevirtual address into a physical memory address. However, if a given pageis not in the TLB 608 (e.g., a page not having been accessed in time), adelay is incurred in performing address translation while the physicaladdress is determined.

As shown, the processor 604 also executes instructions of a driver 620(e.g., TCP driver that performs both accelerated and nonacceleratedprocessing) that includes a protocol stack 618 (e.g., a TCP/IP protocolstack) and a base driver 610 that controls and configures operation ofNIC 600. Potentially, the base driver 610 and stack 618 may beimplemented as different layers of an NDIS (Microsoft Network DriverInterface Specification) compliant driver 620 (e.g., an NDIS 6.0compliant driver).

As shown in FIG. 6A, in operation the NIC 600 receives a packet 614 froma network (shown as a cloud). As shown, the controller 600 can “split”the packet 614 into its constituent header 614 a and payload 614 b. Forexample, the controller 600 can determine the starting address andlength of a packet's 614 TCP/IP header 614 a and starting address andlength of the packet's 614 payload 614 b. Instead of simply writing averbatim, contiguous copy of the packet 614 into memory 602, thecontroller 600 can cause the packet components 614 a, 614 b to be storedseparately. For example, as shown, the controller 600 can write thepacket's header 614 a into a physical page 612 of memory 602 used forstorage of packet headers, while the packet payload 614 b is writteninto a different location (e.g., a location not contiguous or in thesame page as the location of the packet's header 614 a).

As shown in FIG. 6B, this process can repeat for subsequently receivedpackets. That is, for received packet 616, the controller 600 can appendthe packet's header 616 a to the headers stored in page 612 and writethe packet's payload 616 b to a separate location somewhere else inmemory 602.

To avoid an initial cache miss, a packet's header may be prefetched intocache 606 before header processing by stack 618 software. For example,driver 610 may execute a prefetch instruction that loads a packet headerfrom memory 602 into cache 606. As described above, in somearchitectures, the efficiency of a prefetch instruction suffers when amemory access falls within a page not currently identified in theprocessor's 604 TLB 608. By compactly storing the headers of differentpackets within a relatively small number of pages, these pages can bemaintained in the TLB 608 without occupying an excessive number of TLBentries. For example, when stripped of their corresponding payloads, 32different 128-byte headers can be stored in a single 4-kilobyte pageinstead of one or two packets stored in their entirety.

As shown in FIG. 6C, the page(s) 612 storing headers can be maintainedin the TLB 608, for example, by a memory access (e.g., a read) to alocation in the page. This “touch” of a page may be repeated atdifferent times to ensure that a page is in the TLB 608 before aprefetch. For example, a read of a page may be performed each time aninitial entry in a page of headers is written. Assuming that packetheaders are stored in page 612 in the order received, performing amemory operation for the first entry will likely keep the page 612 inthe TLB 608 for the subsequently added headers.

As shown in FIG. 6D, once included in the TLB 608, prefetch operationsload the header(s) stored in the page(s) 612 into the processor 604cache 606 without additional delay. For example, as shown, the basedriver 610 can prefetch the header 616 a for packet 616 before TCPprocessing of the header by the protocol stack 618.

FIG. 7 illustrates sample operation of a NIC participating in the schemedescribed above. As shown, after receiving 700 a packet, the controllercan determine 702 whether to perform header splitting. For example, thecontroller may only perform splitting for TCP/IP packets or packetsbelonging to particular flows (e.g., particular TCP/IP connections orAsynchronous Transfer Mode (ATM) circuits).

For packets selected for splitting, the controller can cause storage 704(e.g., via Direct Memory Access (DMA)) of the packet's header in thepage(s) used to store headers and separately store 706 the packet'spayload. For example, the controller may consume a packet descriptorfrom memory generated by the driver that identifies an address to use tostore the payload and a different address to use to store the header.The driver may generate and enqueue these descriptors in memory suchthat a series of packet headers are consecutively stored one after theother in the header page(s). For instance, the driver may enqueue adescriptor identifying the start of page 612 for the first packet headerreceived (e.g., packet header 614 b in FIG. 6A) and enqueue a seconddescriptor identifying the following portion of page 612 for the nextpacket header (e.g., packet header 616 b in FIG. 6B). Alternately, thecontroller may maintain pointers into the set of pages 612 to storeheaders, essentially using the pages as a ring buffer for receivedheaders.

As shown, after writing the header, the controller signals 708 aninterrupt to the driver indicating receipt of a packet. Potentially, thecontroller may implement an interrupt moderation scheme and signal aninterrupt after some period of time and/or the receipt of multiplepackets.

FIG. 8 illustrates sample operation of the driver in this scheme. Asshown, after receiving 810 an interrupt for a split packet 812, thedriver can issue a prefetch 814 instruction to load the header into theprocessor's cache (e.g., by using the packet descriptor's headeraddress). Potentially, the packet may then be indicated to the protocolstack. Alternately, however, the driver may defer immediate indicationand, instead, build an array of packets to indicate to the stack in abatch. For example, as shown, the driver may add 816 the packet's headerto an array and only indicate 820 the array to the stack if 816 somethreshold number of packets have be added to the array or if somethreshold period of time has elapsed since indicating a previous batchof packets. Since prefetching data into the cache into memory takes sometime, moderating indication to the stack increases the likelihood thatprefetching completes for several packet headers before the data isneeded. Depending on the application, it may also be possible tospeculatively prefetch some of the payload data before the payload isaccessed by the application.

FIG. 9 illustrates a sample computer architecture that can implement thetechniques described above. As shown, the system includes a chipset 630that couples multiple processors 604 a-604 n to memory 632 and NIC 600.The processors 604 a-604 n may include one or more caches. For example,a given processor 604 a-604 n may feature a hierarchy of caches (e.g.,an L2 and L3 cache). The processors 604 a-604 n may reside on differentchips. Alternately, the processors 604 a-604 n may be differentprocessor cores 604 a-604 n integrated on a common die.

The chipset 630 may interconnect the different components 600, 632 tothe processor(s) 604 a-604 n, for example, via an Input/Outputcontroller hub. The chipset 630 may include other circuitry (e.g., videocircuitry and so forth).

As shown, the system includes a single NIC 600. However, the system mayinclude multiple controllers. The controller(s) can include a physicallayer device (PHY) that translates between the analog signals of acommunications medium (e.g., a cable or wireless radio) and digitalbits. The PHY may be communicatively coupled to a media accesscontroller (MAC) (e.g., via a FIFO) that performs “layer 2” operations(e.g., Ethernet frame handling). The controller can also includecircuitry to perform header splitting.

Many variations of the system shown in FIG. 9 are possible. For example,instead of a separate discrete NIC 600, the controller 600 may beintegrated within the chipset 630 or a processor 604 a-604 n.

In an embodiment, as illustrated in FIG. 10, NIC 100 (or networkcontroller 212) may store the header 614 a, 616 a and payload 614 b, 616b in separate buffers, and additionally store the header 614 a, 616 a toa location in which the payload 614 b, 616 b is written. Putdifferently, the payload 614 b, 616 b may be stored to a first location,while the header 614 a, 616 a may be stored to the first location, aswell as a second location different from the first location. Since someoperating systems, such as Microsoft® Windows®, may expect that allpackets be passed up to the host stack in a single buffer, thismaintains the single buffer requirement for non-offload packets, whileallowing the split header feature to be used for offload packets.

A method in accordance with this embodiment is illustrated in FIG. 11.The method begins at block 1100, and continues to block 1102 wherecircuitry may store a packet header at a set of at least one page ofmemory allocated to storing packet headers.

At block 1104, circuitry may store the packet header and a packetpayload at a location not in the set of at least one page of memoryallocated to storing packet headers.

The method may end at block 1106.

In an embodiment, blocks 1102-1104 may be accomplished by using thesplit header feature. In this embodiment, circuitry may split the headerand payload from the packet, and may store the header in the at leastone page of memory, and store the header and payload at a location notin the set of at least one page of memory. In another embodiment, thismay be accomplished by header replication.

The method may end at block 1108.

Another method in accordance with this embodiment is illustrated in FIG.12. The method begins at block 1200, and continues to block 1202 wherecircuitry may receive a packet having a payload portion and a headerportion. The method may continue to block 1204.

At block 1204, circuitry may store the packet in a first location. Themethod may continue to block 1206.

At block 1206, circuitry may replicate the header portion. The methodmay continue to block 1208.

At block 1208, circuitry may store the header portion in a locationdifferent from the first location. The method may continue to block1210.

At block 1210 it may be determined if the packet is a candidate foraccelerated processing. The method may continue to block 1212.

At block 1212, if the packet is a candidate for accelerated processing,circuitry may perform accelerated processing on the packet. The methodmay continue to block 1214.

The method may end at block 1214.

Embodiments of the present invention may be provided, for example, as acomputer program product which may include one or more machine-readablemedia having stored thereon machine-executable instructions that, whenexecuted by one or more machines such as a computer, network ofcomputers, or other electronic devices, may result in the one or moremachines carrying out operations in accordance with embodiments of thepresent invention. A machine-readable medium may include, but is notlimited to, floppy diskettes, optical disks, CD-ROMs (Compact Disc-ReadOnly Memories), and magneto-optical disks, ROMs (Read Only Memories),RAMs (Random Access Memories), EPROMs (Erasable Programmable Read OnlyMemories), EEPROMs (Electrically Erasable Programmable Read OnlyMemories), magnetic or optical cards, flash memory, or other type ofmedia/machine-readable medium suitable for storing machine-executableinstructions.

Moreover, embodiments of the present invention may also be downloaded asa computer program product, wherein the program may be transferred froma remote computer (e.g., a server) to a requesting computer (e.g., aclient) by way of one or more data signals embodied in and/or modulatedby a carrier wave or other propagation medium via a communication link(e.g., a modem and/or network connection). Accordingly, as used herein,a machine-readable medium may, but is not required to, comprise such acarrier wave.

Conclusion

Therefore, in one embodiment, a method may comprise storing a packetheader at a set of at least one page of memory allocated to storingpacket headers, storing a packet payload at a location not in the set ofat least one page of memory allocated to storing packet headers, andstoring the packet header at the location in which the packet payload isstored.

Embodiments of the invention may significantly reduce TCP/IP processingoverhead that may result from using the core processing module of a hostprocessor. TCP/IP processing may be accelerated by using a data movementmodule, such as a DMA engine, to move data from one buffer to anotherbuffer. Since the core processing module of a host processor may bebypassed using a DMA engine, slow memory access speeds may be avoided.Furthermore, TCP/IP processing performed on the host processor may scalebetter than TOE processing because the number of contexts is not limitedby TOE memory.

Furthermore, processing performance of non-offload packets may beimproved by storing the packet in one location, and the header inanother location. In these embodiments, a header portion of a packet maybe placed in a header buffer, and the data portion of the packet may beplaced in a data buffer. The header portion may additionally be placedin the data buffer along with the data portion. This may be accomplishedby header splitting, or by header replication. For offload packets, thetwo buffers may be indicated to a driver for accelerated processing, andfor non-offload packets, a single buffer comprising the data portion andheader portion may be indicated to the driver for non-acceleratedprocessing.

In the foregoing specification, the invention has been described withreference to specific embodiments thereof. It will, however, be evidentthat various modifications and changes may be made to these embodimentswithout departing therefrom. The specification and drawings are,accordingly, to be regarded in an illustrative rather than a restrictivesense.

What is claimed is:
 1. A method comprising: performing packet processingon a packet including extracting a payload from said packet; using adata movement circuit to place the payload corresponding to said packetinto a read buffer substantially simultaneously while performing packetprocessing and substantially simultaneously with a direct memory access(DMA) operation of the data movement circuit.
 2. The method of claim 1,wherein said performing packet processing is performed by a transportprotocol driver.
 3. The method of claim 1, wherein said using a datamovement circuit to place said payload comprises programming the datamovement circuit to write said payload to the read buffer with aprocessor.
 4. The method of claim 1, wherein the data movement circuitcomprises a DMA engine.
 5. The method of claim 4, wherein the DMA engineresides on a chipset.
 6. An apparatus comprising: circuitry to: performpacket processing on a packet including extracting a payload from saidpacket; and substantially simultaneously with the circuitry to performpacket processing, the circuitry to use a data movement circuit to placesaid payload corresponding to said packet into a read buffer; whereinmovement of said payload and said packet processing associated with saidpacket substantially simultaneously overlap and substantiallysimultaneously with a direct memory access (DMA) operation of the datamovement circuit.
 7. The apparatus of claim 6, wherein said circuitry toperform packet processing includes circuitry in a transport protocoldriver.
 8. The apparatus of claim 6, wherein said circuitry to use adata movement circuit to place said payload comprises circuitry toprogram the data movement circuit to write said payload to the readbuffer.
 9. The apparatus of claim 6, wherein the data movement circuitcomprises a DMA engine.
 10. The apparatus of claim 9, wherein the DMAengine resides on a chipset.
 11. A system comprising: a chipset having aDMA (direct memory access) engine, the chipset communicatively coupledto a transport protocol driver of a processor and to a networkcomponent; and circuitry to: perform packet processing on a packetincluding extracting a payload from said packet; and substantiallysimultaneously with the circuitry to perform packet processing, thecircuitry to use the DMA to place said payload corresponding to saidpacket into a read buffer; wherein movement of said payload and saidprotocol packet compliance processing associated with said packetsubstantially simultaneously overlap and substantially simultaneouslywith a direct memory access (DMA) operation of the DMA engine.
 12. Thesystem of claim 11, wherein said circuitry to perform packet processingincludes circuitry in a transport protocol driver.
 13. The system ofclaim 11, wherein said circuitry to use a data movement circuit to placesaid payload comprises circuitry to program the data movement circuit towrite said payload to the read buffer.
 14. A non-transitory machinereadable storage medium which stores instructions executable by amachine which performs the following: performing packet processing on apacket including extracting a payload from said packet; and causing adata movement circuit to place said payload corresponding to said packetinto a read buffer substantially simultaneously while performing packetprocessing and substantially simultaneously with a direct memory access(DMA) operation of the data movement circuit.
 15. The non-transitorymachine readable storage medium of claim 14, wherein packet processingis performed in a transport protocol driver.
 16. The non-transitorymachine readable storage medium of claim 14, wherein using a datamovement circuit to write said payload to the read buffer.
 17. Thenon-transitory machine readable storage medium of claim 14, wherein thedata movement circuit comprises a DMA engine.
 18. The non-transitorymachine readable storage medium of claim 17, wherein the DMA engineresides on a chipset.